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Abstract 

Progressive cognitive decline is a feature of Huntington's disease (HD), an inherited neurodegenerative movement 
disorder. Comprehensive neuropsychological testing is the 'gold standard' to establish cognitive status but is often 
impractical in time-constrained clinics. The study evaluated the utility of brief cognitive tests (MMSE and MoCA), 
UHDRS measures and a comprehensive neuropsychological tests battery in monitoring short-term disease progression 
in HD. Twenty-two manifest HD patients and 22 matched controls were assessed at baseline and 12-month. A linear 
mixed-effect model showed that although the HD group had minimal change in overall global cognition after 
1 2 months, they did show a significant decline relative to the control group. The controls exhibited a practice effect in 
most of the cognitive domain scores over time. Cognitive decline at 12-month in HD was found in the executive 
function domain but the effect of this on global cognitive score was masked by the improvement in their language 
domain score. The varying practice effects by cognitive domain with repeated testing indicates the importance of 
comparing HD patients to control group in research trials and that cognitive progression over 12 months in HD should 
not be judged by changes in global cognitive score. The three brief cognitive tests effectively described cognition of 
HD patients on cross-sectional analysis. The UHDRS cognitive component, which focuses on testing executive function 
and had low variance over time, is a more reliable brief substitute for comprehensive neuropsychological testing than 
MMSE and MoCA in monitoring cognitive changes in HD patients after 12 months. 
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Background for easily administered and yet robust tool to detect cogni- 

Huntington's disease (HD) is an inherited neurodegener- tive changes in HD. Comprehensive neuropsychological 

ative disease caused by expansion of CAG trinucleotide testing is necessary to verify cognitive status. However, 

repeats secondary to mutation in the huntingtin gene on neuropsychological batteries are time-consuming and 

chromosome 4pl6.3 [1]. The disease is characterized by brief cognitive screening tools such as the Mini Mental 

involuntary hyperkinetic movements, cognitive impair- State Examination (MMSE) and the Montreal Cognitive 

ment and behavioural disorders. Cognitive impairment, Assessment (MoCA) are commonly used in clinical set- 

which may be evident even in gene-positive individuals tings and in a broad range of conditions. The Unified 

yet to be clinically diagnosed [2-5], is progressive in nature Huntington s Disease Rating Scale (UHDRS), a standard 

and a contributing factor in the loss of everyday function assessment tool for HD, also includes a brief cognitive 

[6]. Subtle cognitive impairment can be overlooked by cli- component. 

nicians during routine follow-up [7], indicating the need The MMSE [8] comprises eleven questions spanning 

five aspects of cognitive function: executive function, lan- 

— : . - — guage, memory function, visuospatial ability and orienta- 
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and other disorders featuring cognitive impairment [10]. 
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Nevertheless, it is influenced by demographic factors such 
as age, education and cultural background [9,11,12]. The 
MoCA places greater emphasis than the MMSE on nam- 
ing, attention, abstraction and delayed recall, functions 
that are most likely to be compromised in the earlier 
stages of cognitive impairment and unlike the MMSE, it 
compensates for education level [13]. Both the MMSE 
and MoCA have been employed as measures of cognitive 
performance in manifest HD patients [14-17] and MoCA 
was also found to have higher sensitivity without losing 
specificity than the MMSE in identifying those with cog- 
nitive impairment in HD [16]. Furthermore, Bezdicek 
et al. [17] demonstrated a strong correlation between 
the MoCA scores and comprehensive neuropsychological 
assessment scores in manifest HD patients. The UHDRS 
cognitive component [18] includes three tests of executive 
function - letter fluency test, Symbol Digit Modalities test 
and Stroop test; which can be used with corrected norms 
to attenuate the impact of various demographic variables 
[19,20]. 

The progressive nature of HD means that any cog- 
nitive assessments should also be useful longitudinally. 
HD patients are routinely followed up at clinics at 6- 
month and 12-month intervals thus it is preferable that 
brief cognitive assessment tools are sensitive to changes 
even over relatively short time intervals. Effective yet 
brief cognitive tools would enable easier detection of 
cognitive changes in HD patients in clinic settings than 
time consuming comprehensive cognitive assessment 
and also assist health care providers in designing treat- 
ment and care plans aimed at improving patient s quality 
of life. MMSE and MoCA have been extensively evalu- 
ated in previous cross-sectional HD studies [14-16] but 
to our knowledge, there is no longitudinal data on the 
utility of these brief cognitive tests compared to UHDRS 
cognitive assessment in monitoring cognitive changes in 
HD patients. Therefore the objective of this study was to 
examine and compare the relative utility of two widely 
used brief cognitive tests (MMSE and MoCA) concur- 
rently with the UHDRS cognitive assessment to a com- 
prehensive neuropsychological test battery for monitoring 
cognitive changes in HD patients over a short interval of 
12 months. Such a direct comparison has not been previ- 
ously reported. 

Methods 

Study participants were a convenience sample of 22 
manifest HD patients (10 males and 12 females) with 
mild to moderate disease severity and 22 age, gender 
and education matched control volunteers recruited 
through the New Zealand Brain Research Institute data- 
base (Table 1). Patients were genetically verified and clin- 
ically diagnosed by a movement disorders specialist (TJA). 
Participants identified themselves as native speakers of 



Table 1 Demographic characteristics (mean and SD) of 
control and HD groups 





Mean (SD) 






Control group 


HD group 




n = 22 


n = 22 


Age 


50(15) 


50 (15) 


CAG repeat no. 




44 (4) 


Education level (years) 


13(2) 


13(2) 


Follow-up interval (weeks) 


53 (3) 


54 (4) 


Retention rate at 1 2-month 


91%(n = 20) 1( 


30% (n = 22) 



English and consented to participate in compliance with 
the requirements of the New Zealand Ministry of Health 
Ethics Committee. 

Experiment procedure 

The MMSE, MoCA and a comprehensive neuropsycho- 
logical test battery were administered to all participants. 
The comprehensive assessment of cognitive function 
used 19 neuropsychological tests to assess six domains 
of cognitive function (executive function; working mem- 
ory and attention; learning and memory; processing speed; 
language; and visuospatial function). These tests were: ex- 
ecutive function: letter, action and category fluency tests 
[21], Trail Making Test (Part B), Stroop-interference test; 
working memory and attention: digits forward, backward 
and sequencing tests [22], Symbol Digit Modalities Test 
[23] and Ruff 2 & 7 Cancellation Test - Accuracy [24]; 
learning and memory: Short California Verbal Learn- 
ing Test-II and Brief Visuospatial Memory Test-Revised; 
processing speed: Stroop-word reading, Stroop-colour 
naming, Trail Making Test (Part A) and Ruff 2 & 7 
Cancellation Test - Speed; language: Brief Boston Naming 
Test [25] and Indiana University Token Test [26]; and 
visuospatial function: Judgement of Line Orientation test 
(Form H) and Rey Complex Figure Copying test. For the 
MMSE, both alternatives ('World' spelled backwards and 
serial sevens) were assessed. The number of tests adminis- 
tered was evenly distributed over two separate sessions, 
one week apart and presented in the same order for all 
participants. Each session began with the MMSE in the 
first and MoCA in the second session. The three-part 
UHDRS, comprising motor, cognitive and behavioural 
components, was administered in the first session to the 
HD group only. All returning participants were reassessed 
in identical manner 12 months later. 

Data analysis 

Cognitive status - normal, mild cognitive impairment 
(MCI) or dementia - of HD participants was determined 
using evidence from the neuropsychological test battery 
and the UHDRS. Criteria for mild cognitive impairment 
(MCI) followed that described for Parkinsons disease by 
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Dalrymple-Alford et al [27], with a requirement of 2 
measures at -1.5 SD or equivalent within a single domain; 
and dementia criteria followed that of Peavy et al. [5], 
which defined HD dementia as having cognitive deficits 
in at least two areas of cognition not limited to memory 
deficits in the context of impaired everyday function as 
determined through the UHDRS Functional Independ- 
ence Scale. 

The raw score of each component test in the neu- 
ropsychological test battery was converted to a standard 
z-score using test-specific norms so that objective com- 
parison can be made across component tests, regardless 
of individual scale ranges and distributions. Domain- 
specific scores were mean aggregated scores of compo- 
nent tests within a cognitive domain and the average 
scores across all six cognitive domains determined the 
global cognitive z-score (overall global cognition). The 
MoCA scores were adjusted to participants' education 
level [13]. The three cognitive tests (letter fluency, SDMT 
and Stroop tests) in the UHDRS cognitive component 
were part of the neuropsychological test battery so the 
mean aggregate z-score of these tests was used as the 
UHDRS cognitive score for both the HD and control 
groups. 

Statistical analysis 

For each of the measures, the differences between groups 
at baseline and the change over 12 months were de- 
termined using linear mixed-effects models [28]. These 
models take into account the correlated measurements 
within a participant when assessing the differences be- 
tween groups and changes over time. The relationship be- 
tween global cognition and brief cognitive tests, baseline 
and 12-month scores were assessed using R 2 correlation 
coefficient from simple linear models. Bootstrapping [29] 
was used to assess differences between R 2 correlation co- 
efficients as standard analytical techniques were not ap- 
plicable. Bootstrapping involved the original sample being 
resampled with replacement and the difference between 
R 2 values in this new sample being determined. This was 
repeated 1000 times and the resulting distribution of dif- 
ferences in R 2 values gave an indication of the mean differ- 
ence and a 95% confidence interval. Cohens d was used to 
report effect sizes of differences between groups. 

Results 

Cognition at baseline and change over time 

At baseline, six HD patients had normal cognition, 10 
met criteria for MCI, and six had dementia [5]. All 22 
controls had normal cognition. The HD group showed 
significantly reduced scores (t > 3.5, p < 0.001) in overall 
global cognition and brief cognitive tests compared to 
controls both at baseline and at 12-month follow-up. 
The mean effect sizes for the two years combined in 



overall global cognition was d = 2.6 whereas in the brief 
cognitive tests, they ranged from d = 1.3 in the MMSE 
with World' spelled backwards to d = 2.4 in UHDRS 
cognitive assessment (Figure 1A, Table 2). In terms of 
domain-specific scores, the HD group had significantly 
lower scores (t > 4.7, p < 0.001) compared to controls 
across all cognitive domains and the mean effect sizes 
for baseline and 12-month combined ranged from the 
smallest (d = 1.5) in the language domain to the largest 
(d = 2.8) in the executive function domain (Figure IB, 
Table 2). Individual component test scores in HD and 
control groups at baseline and 12-month are detailed in 
Additional file 1: Figure SI and brief cognitive tests in 
Additional file 2: Table SI. 

There was an overall pattern of improvement in the 
control group across all cognitive tests after 12 months. 
In contrast, the HD group showed minimal change in 
their global cognitive z-score and a general decline across 
all brief cognitive tests scores after 12 months, for which it 
was statistically significant (t < - 2.0, p = 0.048) in UHDRS 
cognitive score and MMSE with 'World' spelt backwards 
(Figure 1A, Table 2). The control group exhibited an in- 
crease in score at 12 months in most cognitive domains 
(t > 2.2, p < 0.04) excepting executive function and visuo- 
spatial domains (t < 1.6, p > 0.1). Contrastingly, the HD 
group demonstrated a decline (t = 2.3, p = 0.03) in execu- 
tive function domain but an increase (t = 2.7, p = 0.01) in 
language domain z-score 12 months later. There were no 
significant absolute changes (t < 1.2, p > 0.3) in the other 
cognitive domains in the HD group (Figure IB, Additional 
file 2: Figure SI). A relative change over time (i.e. relative 
deterioration) in the HD group compared to change in 
scores in the control group was significant for global cog- 
nitive z-score, MMSE with World' spelled backwards, ex- 
ecutive function, and learning and memory domain scores 
(Table 2). There was a significant worsening (t = 3.9, p < 
0.001) of the UHDRS motor score over 12 months in the 
HD group but no change in behavioural score (Table 2). 

Usefulness of scores for measuring change over time 

There are several considerations to take into account 
when determining which brief cognitive test has greatest 
utility for measuring cognition over time. This includes 
how well the score reflects overall global cognition, whe- 
ther there is any ceiling effect, and how noisy (variability 
of score residuals) the score is after taking systematic 
changes into consideration. 

Simple linear models confirmed that scores of all 
three brief cognitive screening tests, as judged by their R 2 
values, were significantly correlated with the scores of the 
full neuropsychological test battery at baseline (Figure 2) 
and 12-month (not shown). Bootstrap procedures con- 
firmed that there were no significant differences bet- 
ween the three brief cognitive screening tests in extent 
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Figure 1 Change in cognitive scores over 12 months. Baseline and 12-month scores for control and HD groups in: (A) overall global cognition; 
UHDRS cognitive assessment; MMSE-WORLD; MMSE-Sevens; MoCA; and (B) the six cognitive domains. Group mean and SD are shown. 



of correlation with overall global cognition (Table 3). 
Thus all brief cognitive tests provided a reasonable cross- 
sectional measure of global cognition. 

To determine the variability of score residuals over 
time, simple linear models were fitted to the baseline 
and 12-month scores of overall global cognition and 
brief cognitive tests. The correlations within a test over 
time were evaluated by examining the R 2 values of the 
model fits (Figure 3). In the control group, the range of 
scores in MMSE and MoCA was narrow due to a ceiling 
effect hence contributing to R 2 values (R 2 < 0.36). In 
contrast, the global z-score and UHDRS cognitive com- 
ponent showed greater utility in the control group, with 
a wider range of values together and small deviations 
from the linear fit, resulting in high R 2 values. In the HD 
group the baseline scores were well correlated (R 2 > 
0.67) with 12-month scores for overall global cognition 



and all three brief cognitive tests (Figure 3). The com- 
prehensive neuropsychological test battery and UHDRS 
cognitive component, as confirmed by bootstrap proce- 
dures, had smaller deviations from the linear fit than the 
two versions of the MMSE but not the MoCA (Table 4). 
This finding indicates that the two versions of MMSE 
had higher measurement noise (i.e. greater score vari- 
ability over time), compared to overall global cognition 
and UHDRS cognitive assessment after 12 months. 

In summary, the combination of showing a significant 
decline of cognition in HD (Table 2), high correlation 
with global cognitive z-score (Figure 2), and lower vari- 
ance of score residuals over time (Figure 3) compared to 
other brief cognitive assessments, indicated the UHDRS 
cognitive component performed the best of the brief 
cognitive tests in assessing and monitoring cognition in 
HD patients over a 12-month period. 
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Table 2 Scores" at baseline, within-group changes and group over time interactions of control and HD groups 



Measures 


Control group 






HD group 


HD vs. Controls 


Baseline 
Mean [95% CI] 


Change after 1 2 months 
Mean [95% CI] 


Baseline 
Mean [95% CI] 


Change after 12 months 
Mean [95% CI] 


Relative change after 1 2 months 
Mean [95% CI] 


Overall global 
cognition 


0.4 [0.2 - 0.7] 


0.2 [0.1 - 0.3], p < 0.001 


-1.2 


[-1.4- -0.9] 


0.01 [-0.1 -0.1],p = 0.8 


-0.2 [-0.4 - -0.1], p = 0.006 


Executive function 


0.8 [0.4 - 1 .2] 


0.1 [-0.04 - 0.1], p = 0.1 


-1.4 


[-1.7- -1.0] 


-0.2 [-0.4 - -0.02], p = 0.03 


-0.3 [-0.6 - -0.1], p = 0.01 


Working memory & 
attention 


0.2 [-0.1 - 0.5] 


0.2 [0.05 - 0.3], p = 0.01 


-1.0 


[-1.2- -0.7] 


0.08 [-0.1 - 0.2], p = 0.3 


-0.1 [-0.3 - 0.1], p = 0.3 


Learning & memory 


0.5 [0.1 - 0.9] 


0.6 [0.3 - 0.9], p < 0.001 


-1.0 


[-1.4- -0.6] 


-0.04 [-0.3 - 0.2], p = 0.8 


-0.6 [-1.0- -0.3], p< 0.001 


Processing speed 


0.7 [0.3 - 1.1] 


0.1 [0.01 - 0.03], p = 0.04 


-1.4 


[-1.8- -1.0] 


-0.01 [-0.1 -0.1]p = 0.8 


-0.2 [-0.3 - 0.02], p = 0.09 


Language 


0.1 [-0.2 - 0.4] 


0.3 [0.1 - 0.6], p = 0.008 


-0.9 


[-1.2- -0.6] 


0.3 [0.1 - 0.6], p = 0.01 


-0.02 [-0.4 - 0.3], p = 0.9 


Visuospatial 


0.3 [0.0 - 0.6] 


-0.02 [-0.2 - 0.2], p = 0.8 


-1.4 


[-1.7- -1.1] 


-0.07 [-0.2 - 0.3], p = 0.5 


-0.04 [-0.3 - 0.2], p = 0.8 


UHDRS cognitive 
score 


0.6 [0.2 - 1 .0] 


0.06 [-0.1 - 0.2], p = 0.5 


-1.5 


[-1.9- -1.1] 


-0.2 [-0.3- -0.001], p = 
0.048 


-0.2 [-0.4 - 0.01], p = 0.06 



Measures 



Control group 



Points 
HD group 



HD vs. Controls 



Baseline Change after 12 months Baseline Change after 12 months 
Mean [95% CI] Mean [95% CI] Mean [95% CI] Mean [95% CI] 



Relative change after 1 2 months 
Mean [95% CI] 



MMSE 



with WORLD item 


29 [28 - 


30] 


0.4 


[-0.3 - 


1.1], p 


= 0.3 


26 [25 - 


28] 


-0.8 [-1.5 - 0.08], p = 0.03 


-1.2 [• 


-2.2- 


-0.2], p = 


0.02 


with Sevens item 


29 [28 - 


30] 


0.5 


[-0.4 - 


1.4], p 


= 0.3 


25 [24 - 


26] 


-0.5 [-1.3 - 0.4], p = 0.3 


-1.0 


[-2.2 - 


0.3], p = 


0.1 


MoCA 


28 [26 - 


30] 


0.4 


[-0.6 - 


1.4], p 


= 0.5 


21 [20 - 


23] 


-0.5 [-1.5 - 0.5], p = 0.3 


-0.9 


[-2.3 - 


0.5], p = 


0.2 


UHDRS motor score* 














42 [33 - 


51] 


7.4 [3.4- 11.3], p < 0.001 










UHDRS behavioural 

score* 














23 [17- 


30] 


0.7 [-6.4 - 7.8], p = 0.8 











*UHDRS motor and behavioural components were assessed in the HD group only. 

# Baseline and 12-month SD and ranges for all variables are detailed in Additional file 2: Table S1 and score changes after 12 months in individual component tests 
are shown in Additional file 1: Figure SI. 



Discussion 

This study attempted to evaluate the usefulness of two 
widely used brief cognitive assessment tools (MMSE and 
MoCA) simultaneously with UHDRS cognitive component 
for monitoring cognitive changes in manifest HD patients 
over a 12-month interval by comparing them to a compre- 
hensive neuropsychological test battery. In the process of 
evaluating the usefulness of these brief cognitive tests, we 
demonstrated that there was no significant change in overall 
global cognition in the presence of significant decline in the 
executive function domain in manifest HD patients after 12 
months. Relative to the control group, which showed an in- 
crease in overall global cognitive z-score and learning and 
memory domain score over a 12-month period, there was 
significantly less change in domain-specific scores in the HD 
group over that period. The MMSE and MoCA were less ef- 
fective than the UHDRS cognitive assessment for monitoring 
cognitive changes in manifest HD patients over 12 months. 

Domain-specific cognitive performance 

Cognitive decline, which has been shown to assume a 
relatively slow course especially in the early stages of 



HD [30-33], is a well-established hallmark of HD. Over- 
all, our findings corroborated with other longitudinal 
studies on pre-manifest and early manifest HD patients 
wherein, relative to a control group, cognitive decline 
were evident after a 12-month interval in the HD group 
[30] and, similar conclusions were made at 24-month 
follow-up [31]. The significant decline in executive func- 
tion domain score in the HD score was consistent to a 
study by Bachoud-Levi et al. [32], which demonstrated 
that cognitive deterioration in early stages patients is lim- 
ited to attention and executive functions. However, unlike 
their study which also showed significant changes in vis- 
uospatial and language functions over time, such changes 
were not evident in our study suggesting that such chan- 
ges were limited in early HD and not across different 
stages of HD. Executive function domain has always been 
recognized to be the most vulnerable in HD [34] with pro- 
gressive impairment evident not just in early stages of HD 
[32,35] but also in pre-manifest HD patients [36]. 

In contrast to the HD group, which had minimal change 
in overall global cognition over time, the control group 
had a significant improvement in their scores over time. 
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Figure 2 Correlations between brief cognitive screening tests scores and global cognitive z-scores at baseline. The control group is 
shown in the top row and the HD group in the bottom row. The R 2 and the p values are shown for each of the brief cognitive screening tests. 



This suggested that controls had in general benefitted 
from practice effect on repeated testing of measures in the 
comprehensive neuropsychological test battery. This was 
consistent to previous works on cognitive performance in 
healthy controls in longitudinal studies [37,38]. Practice 
effect in healthy controls is most apparent in the early 
phases of repetitive testing, with performance scores tend- 
ing to plateau on subsequent testing [39,40], or after chan- 
ging to low frequency testing [41]. Atrophy of the caudate 
nucleus, a structure involved in learning process, is found 
in normal aging process but this process when compared 
to healthy controls, occurs at an expedited rate in HD pa- 
tients as demonstrated through serial radio-imaging stu- 
dies [31,42]. Nevertheless, as already reported in a 2 to 4 
year longitudinal study on cognition in early HD patients, 
practice effect was evident in certain executive function 
and memory related tests between first and second assess- 
ments [32]. Although it was reported in that same study 
[32] that practice effect was not observed in language 

Table 3 Comparison of R 2 differences of relationships 



between brief cognitive tests and full cognitive battery 





Differences in R 2 values [95% CI] 






MMSE -WORLD MMSE-Sevens MoCA 




UHDRS cognitive 
component 


0.1 [-0.0 - 0.4] 0.1 [-0.1 - 0.3] 0.0 [-0.2 - 


0.2] 


MMSE - WORLD 


-0.1 [-0.3-0.1] -0.1 [-0.4- 


0.0] 


MMSE - Sevens 


-0.0 [-0.2 - 


0.1] 



performance, our HD cohort had actually shown a signifi- 
cant improvement in language domain score after 12 
months. These findings suggested that HD patients indeed 
could benefit from practice effect over a relative short 
time interval and also showed that underlying disease pro- 
gression may not be translated to measurable cognitive 
performance changes over short time interval. 

Our findings reaffirmed the general slow progression of 
cognitive deterioration in HD patients over short time 
interval which inevitably create great difficulty in monitor- 
ing cognitive changes in HD patients on routine follow-up 
in clinic settings. Longitudinal monitoring of disease pro- 
gression is generally conducted to evaluate potential inter- 
ventions for delaying phenoconversion in HD thus the 
generally accepted view is that it is more meaningful to 
serially evaluate disease progression of pre-manifest HD pa- 
tients. However, understanding short-term changes and the 
utility of various cognitive tools in manifest HD patients 
are also important for multi-disciplinary health team in 
planning and modifying disease management plans which 
consists of currently available pharmacological and non- 
pharmacological interventions aimed at improving patient s 
quality of life. Nevertheless, our findings have implications 
for clinical practice and research. Cognitive decline in HD 
appeared to be specific in executive function and learning 
and memory domains after 12 months. Therefore in the 
clinic, cognitive deterioration in HD over 12-month should 
not be determined by changes in overall global cognitive 
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Figure 3 Correlations between baseline and 12-month scores of the five cognitive measures. Control group is shown in the top row and 

HD group in the bottom row. The R 2 , 95% CI (in square brackets) and p values of the relationship are shown for each of the cognitive measures. 



score of comprehensive neuropsychological test battery but 
by detailed analysis of cognitive domain-specific perform- 
ance. Due to practice effect, it is important in short to 
medium term longitudinal clinical research to include a 
control group when assessing the cognition of HD patients. 

Usefulness of brief cognitive tests for longitudinal 
assessment 

As expected, the MMSE, MoCA and the UHDRS cogni- 
tive component scores correlated well with overall global 
cognition, as determined through the comprehensive 
neuropsychological test battery, in the HD group. These 
findings support the utility of the three brief cognitive 
assessment tools in cross-sectional detection of cognitive 
deficits in manifest HD patients. Furthermore, our find- 
ings showed that there were no significant differences 
between the three brief cognitive tests in reflecting over- 
all global cognition in HD patients, providing no evidence 
that one test is better than the other in this respect. 

However, the baseline scores of comprehensive neuro- 
psychological test battery (overall global cognition) and 
UHDRS cognitive assessment were highly correlated with 
their 12-month scores and as judged by the 95% CI of R 2 



values, both types of assessment had minimal deviations 
from the linear fit indicated that both tests were reliable 
and had low score variability over time. The reliability of 
the MMSE in the HD group, though reasonable, was sig- 
nificantly lower than that for the full neuropsychological 
test battery and the UHDRS cognitive component. Defi- 
ciencies in reliability of MMSE were highlighted in a study 
by Bowie et al. [43], which inferred that the test was in- 
adequate in detecting small cognitive changes. Moreover, 
large score variance on annual assessment was another 
weakness of MMSE as shown in a study on patients with 
Alzheimer's disease [44], which further limits its value in 
assessing disease progression. Similarly in our HD sample, 
the two versions of MMSE were found to have greater 
score variance than the comprehensive neuropsycholo- 
gical test battery and the UHDRS cognitive component. 
Even though the present study demonstrated that there 
were significant within-group changes after a 12-month 
period in the MMSE (with World' spelled backwards) in 
our HD patients, its use in routine follow-up in clinical 
practice should be interpreted with caution because of its 
tendency to vary from one assessment to the next. On the 
contrary, the MoCA and UHDRS cognitive component, 



Table 4 Comparison of R 2 differences of relationships between baseline and 12-month scores in cognitive measures 







Differences in R 2 values [95% CI] 






UHDRS cognitive component 


MMSE - WORLD 


MMSE - Sevens 


MoCA 


Global cognitive z-score 


-0.0 [-0.1 - 0.1] 


0.2 [0.0 - 0.4]* 


0.2 [0.0 - 0.5]* 


0.1 [-0.0 - 0.3] 


UHDRS cognitive component 




0.2 [0.0 - 0.5]* 


0.2 [0.0 - 0.4]* 


-0.1 [-0.0 - 0.4] 


MMSE - WORLD 






0.0 [-0.2-0.1] 


-0.1 [-0.3 - 0.1] 


MMSE - Sevens 








-0.1 [-0.3 - 0.2] 



*The estimated 95% CI of R differences is greater than '0.0' which suggests that the difference in R values between the two cognitive measures tested could be 
considered significant. 
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as judged by the differences of R 2 values from linear fit 
models using bootstrap procedure, had comparable per- 
formance to the comprehensive neuropsychological bat- 
tery. Such findings are likely to be attributed by the nature 
of short-term cognitive progression in HD which is spe- 
cific to executive function and also the overall design of 
the tests. The MoCA, which was claimed to have superior 
sensitivity for detecting MCI compared to MMSE, con- 
tains more demanding tasks for assessing executive and 
memory functions [45] while the UHDRS cognitive com- 
ponent essentially assesses the executive function domain. 
However, MoCA is an assessment tool that examines mul- 
tiple cognitive domains hence similar to the overall global 
cognitive score of comprehensive neuropsychological bat- 
tery, short-term cognitive decline in HD patients could be 
masked by practice effect in other domains within the 
test. 

On the basis of high correlation to comprehensive neu- 
ropsychological battery and low variance across time, the 
UHDRS cognitive component is a good brief substitute 
for comprehensive neuropsychological testing and a sen- 
sitive cognitive measure to assess short-term cognitive 
changes in HD patients compared to MMSE and MoCA. 
However, the MoCA and MMSE, in that order, might 
be considered as reasonable alternatives to the 'gold 
standard' for use in clinic setting in circumstances where 
the UHDRS cognitive component is unavailable but sec- 
ondary to the limitations of MMSE and MoCA, their re- 
sults shall be interpreted discretely. 

Other disease measures 

There was no significant worsening in the UHDRS be- 
havioural score within our HD group at follow-up, simi- 
lar to prior observations [18]. Behavioural abnormalities 
in HD are heterogeneous in nature and without clear 
temporal progression [46]. Furthermore, psychiatric in- 
terventions are often effective in managing behavioural 
disturbances of HD patients [47] so such features are 
less likely to exhibit progressive deterioration over time. 
Thus, the UHDRS behavioural index is not particularly 
useful as a measure of short to medium term disease 
progression in HD. In contrast to the absence of meas- 
urable change in the behavioural measure, there was a 
significant increase in the UHDRS motor score over 12 
months. This is consistent with the Huntington Study 
Groups [18] report of an average three points increase 
in motor score over six months in manifest HD patients. 
The ability to demonstrate increase in the UHDRS mo- 
tor score is not exclusive to manifest HD patients, with 
another study on pre-manifest patients showing that 
while the change was minimal after one year, there was 
significant increase in motor scores over five years [48]. 
These observations combined suggest that motor deteri- 
oration is possibly more aggressive in the short term 



than cognitive and behavioural changes in HD patients. 
However, the interpretation of the study findings was un- 
doubtedly constrained by its small sample size and also 
limited number of patients in different disease stages. 

Concluding remarks 

Although MMSE and MoCA have been evaluated in 
previous cross-sectional HD studies [14-16], the utility 
of these brief cognitive tests has not been appraised lon- 
gitudinally. This study provided a new perspective on 
the utility of two widely used brief cognitive assessment 
tools (MMSE and MoCA) in comparison to UHDRS cog- 
nitive assessment and other measures for monitoring cog- 
nitive changes in manifest HD patients over a 12-month 
period. MMSE and MoCA may be effective for describing 
global cognition in HD patients in cross-sectional analysis 
but they are less useful for monitoring longitudinal cog- 
nitive changes over short time interval. The UHDRS 
cognitive assessment, which focuses on testing execu- 
tive function, is sensitive to short-term cognitive changes 
in HD and a more reliable brief assessment tool compared 
to MMSE and MoCA over 12 months. Nevertheless, our 
findings on the utility of these assessment tools in a re- 
stricted cohort of HD patients should be interpreted dis- 
cretely and further studies on these brief cognitive tests 
are warranted in the future. 

Additional files 



Additional file 1: Figure SI. Change in neuropsychological battery 
component tests scores over 12 months. Baseline and 12-month scores 
for control and HD groups in overall executive domain score (Overall: Ex); 
letter fluency (LF); action fluency (AF); category switching (CS); Trail 
Making Test - Part B (Trl.B); Stroop-lnterference test (Strp.l); overall 
working memory domain (Overall: WM); digit forward, backward and 
sequencing combined score (DF.B.Sq); digit backward (DB); digit sequencing 
(Dsq); Symbol Digit Modalities Test (SDMT); Ruff 2 &7 Cancellation Test - 
Accuracy (R27TotA); overall learning memory & attention domain score 
(Overall: LM); CVLT - Recall score (CV.Recall); CVLT - Long delayed score (CV. 
LongD); BVMT - Learning score (BVMT.Learn); BVMT - Delayed recall score 
(BVMTDelayd); overall processing speed domain score (Overall: PS); Stroop - 
Reading test (Strp.WR); Stroop - Naming test (Strp.CN); Trail Making Test - 
Part A (Trl.A); Ruff 2 & 7 Cancellation Test - Speed (R27TotS); overall 
visuospatial domain score (Overall: Vs); Judgement of line (JOL); Rey 
complex figure copying test (RCF.Copy); overall language domain score 
(Overall: La); Brief Boston Naming Test (BNT); and Indiana University Token 
Test (IUTT). Group mean and SD are shown. 

Additional file 2: Table SI. Scores (mean, SD & range) in control and 
HD groups at baseline and 12-month. Neuropsychological tests raw 
scores were converted to standard z-score using test-specific norms. 
Overall global cognition and domain scores were shown in z-scores. 
MMSE and MoCA were scored out of 30 points. UHDRS motor and 
behavioural components were scored in points while individual tests 
within the cognitive component were reported in z-scores. 



Abbreviations 

HD: Huntington's disease; MCI: Mild cognitive impairment; MMSE: Mini 
Mental State Examination; MoCA: Montreal Cognitive Assessment; 
SD: standard deviation; UHDRS: Unified Huntington's Disease Rating Scale; 
(95% CI): 95% confidence interval. 



Toh et al. Translational Neurodegeneration 2014, 3:15 
http://www.translationalneurodegeneration.eom/content/3/1/15 



Page 9 of 10 



Competing interests 

The authors declare that there are no conflicts of interest in this research. 
Authors' contributions 

The study was conceptualised by EAT, MRM, JDA and TJA. EAT was the main 
author and analyzed the data, MRM evaluated the manuscript structure, 
ideas and science, JDA reviewed the manuscript structure, ideas and science, 
DJM was the main advisor for statistical analyses and appraised the 
manuscript structure and ideas, LL reviewed manuscript ideas, ADM 
reviewed the manuscript, TJA evaluated the manuscript structure, ideas and 
science. The final manuscript was read and approved by all authors. 

Acknowledgements 

The study was supported by grants from McGee Fellowship fund and a 
University of Otago Doctoral Scholarship. The authors are grateful to the HD 
patients, healthy controls and Ms. Maggie Jury, coordinator of clinical 
services for HD patients in Christchurch, for their participation and support in 
this project. 

Author details 

department of Medicine, Christchurch School of Medicine & Health 
Sciences, University of Otago, Christchurch, New Zealand. 2 New Zealand 
Brain Research Institute, Christchurch, New Zealand, department of 
Psychology, University of Canterbury, Christchurch, New Zealand. 4 Brain 
Injury Rehabilitation Service, Canterbury District Health Board, Christchurch, 
New Zealand, department of Neurology, Canterbury District Health Board, 
Christchurch, New Zealand. 

Received: 28 March 2014 Accepted: 6 July 2014 
Published: 12 July 2014 

References 

1. Huntington Disease Collaborative Research Group: A novel gene 
containing a trinucleotide repeat that is expanded and unstable on 
Huntington's disease chromosomes. The Huntington's Disease 
Collaborative Research Group. Cell 1993, 72:971-983. 

2. Blackmore L, Simpson SA, Crawford JR: Cognitive performance in UK 
sample of presymptomatic people carrying the gene for Huntington's 
disease. J Med Genet 1 995, 32:358-362. 

3. Duff K, Paulsen J, Mills J, Beglinger LJ, Moser D, Smith MM, Langbehn D, 
Stout J, Queller S, Harrington DL: Mild cognitive impairment in 
prediagnosed Huntington disease. Neurology 2010, 75:500-507. 

4. Kirkwood SC, Siemers E, Stout JC, Hodes ME, Conneally PM, Christian JC, 
Foroud T: Longitudinal cognitive and motor changes among 
presymptomatic Huntington disease gene carriers. Arch Neurol 1999, 
56:563-568. 

5. Peavy GM, Jacobson MW, Goldstein JL, Hamilton JM, Kane A, Gamst AC, 
Lessig SL, Lee JC, Corey-Bloom J: Cognitive and functional decline in 
Huntington's disease: dementia criteria revisited. Mov Disord 2010, 
25:1163-1169. 

6. Bates G, Harper PS, Jones L: Huntington's disease. New York: Oxford 
University Press; 2002. 

7. Chodosh J, Petitti DB, Elliott M, Hays RD, Crooks VC, Reuben DB, Galen 
Buckwalter J, Wenger N: Physician recognition of cognitive 
impairment: evaluating the need for improvement. J Am Geriatr Soc 
2004, 52:1051-1059. 

8. Folstein MF, Folstein SE, McHugh PR: "Mini-mental state". A practical 
method for grading the cognitive state of patients for the clinician. 
J Psychiatr Res 1975, 12:189-198. 

9. Tombaugh TN, Mclntyre NJ: The mini-mental state examination: a 
comprehensive review. J Am Geriatr Soc 1992, 40:922-935. 

10. Godefroy O, Fickl A, Roussel M, Auribault C, Bugnicourt JM, Lamy C, 
Canaple S, Petitnicolas G: Is the Montreal Cognitive Assessment Superior 
to the Mini-Mental State Examination to Detect Poststroke Cognitive 
Impairment?: A Study With Neuropsychological Evaluation. Stroke 201 1, 
42:1712-1716. 

1 1 . Scazufca M, Almeida OP, Vallada HP, Tasse WA, Menezes PR: Limitations 
of the Mini-Mental State Examination for screening dementia in a 
community with low socioeconomic status: results from the Sao Paulo 
Ageing & Health Study. Eur Arch Psychiatry Clin Neurosci 2009, 259:8-15. 



12. Wind AW, Schellevis FG, Van Staveren G, Scholten RP, Jonker C, Van Eijk JT: 
Limitations of the Mini-Mental State Examination in diagnosing 
dementia in general practice. Int J Geriatr Psychiatry 1997, 12:101-108. 

13. Nasreddine ZS, Phillips NA, Bedirian V, Charbonneau S, Whitehead V, Collin I, 
Cummings JL, Chertkow H: The Montreal Cognitive Assessment, MoCA: a 
brief screening tool for mild cognitive impairment. J Am Geriatr Soc 2005, 
53:695-699. 

14. Gluhm S, Goldstein J, Brown D, Van Liew C, Gilbert PE, Corey-Bloom J: 
Usefulness of the Montreal Cognitive Assessment (MoCA) in Huntington's 
disease. Mov Disord 201 3, 28:1 744-1 747. 

15. Videnovic A, Bernard B, Fan W, Jaglin J, Leurgans S, Shannon KM: The 
Montreal Cognitive Assessment as a screening tool for cognitive 
dysfunction in Huntington's disease. Mov Disord 2010, 25:401-404. 

16. Mickes L, Jacobson M, Peavy G, Wixted JT, Lessig S, Goldstein JL, 
Corey-Bloom J: A comparison of two brief screening measures of 
cognitive impairment in Huntington's disease. Mov Disord 2010, 
25:2229-2233. 

1 7. Bezdicek O, Majerova V, Novak M, Nikolai T, Ruzicka E, Roth J: Validity of the 
Montreal Cognitive Assessment in the detection of cognitive dysfunction 
in Huntington's disease. Appl Neuropsychol Adult 201 3, 20:33-40. 

18. Huntington Study Group: Unified Huntington's disease rating scale: 
Reliability and consistency. Movement Disorders 1996, 11:136-142. 

19. Sheridan LK, Fitzgerald HE, Adams KM, Nigg JT, Martel MM, Puttier LI, Wong 
MM, Zucker RA: Normative Symbol Digit Modalities Test performance in 
a community-based sample. Arch Clin Neuropsychol 2006, 21:23-28. 

20. O'Bryant SE, O'Jile JR: Attenuating Demographic Influences on Verbal 
Fluency and Animal Naming in a Psychiatric Sample. Applied 
Neuropsychology 2004, 1 1 :208-21 2. 

21. Swanson J: The Delis-Kaplan Executive Function System: A Review. 
Canadian Journal of School Psychology 2005, 20:1 17-128. 

22. Wechsler D: Wechsler Adult Intelligence Scale - Fourth Edition (WAIS-IV) 
administration and scoring manual. San Antonio, TX: Psychological 
Corporation; 2008. 

23. Smith A: Symbol Digit Modalities Test Manual. Western Psychological 
Services: Torrance, CA; 2007. 

24. Ruff RM, Niemann H, Allen CC, Farrow CE, Wylie T: The Ruff 2 and 7 
Selective Attention Test: a neuropsychological application. Percept Mot 
Skills 1992, 75:1311-1319. 

25. Graves RE, Bezeau SC, Fogarty J, Blair R: Boston naming test short forms: a 
comparison of previous forms with new item response theory based 
forms. J Clin Exp Neuropsychol 2004, 26:891-902. 

26. Unverzagt FW, Morgan OS, Thesiger CH, Eldemire DA, Luseko J, Pokuri S, 
Hui SL, Hall KS, Hendrie HQ Clinical utility of CERAD neuropsychological 
battery in elderly Jamaicans. J Int Neuropsychol Soc 1999, 5:255-259. 

27. Dalrymple-Alford JC, Livingston L, MacAskill MR, Graham C, Melzer TR, Porter 
RJ, Watts R, Anderson TJ: Characterizing mild cognitive impairment in 
Parkinson's disease. Mov Disord 201 1, 26:629-636. 

28. Gelman A, Hill J: Data analysis using regression and multilevel/hierarchical 
models. New York: Cambridge University Press; 2007. 

29. Efron B: Bootstrap Methods: Another Look at the Jackknife. The Annals of 
Statistics 1979, 7:1-26. 

30. Tabrizi SJ, Scahill Rl, Durr A, Roos RAC, Leavitt BR, Jones R, Landwehrmeyer 
GB, Fox NC, Johnson H, Hicks SL, Kennard C, Craufurd D, Frost C, Langbehn 
DR, Reilmann R, Stout JC: Biological and clinical changes in premanifest 
and early stage Huntington's disease in the TRACK-HD study: the 
12-month longitudinal analysis. The Lancet Neurology 2010, 10:31-42. 

31. Tabrizi SJ, Reilmann R, Roos RA, Durr A, Leavitt B, Owen G, Jones R, Johnson 
H, Craufurd D, Hicks SL, Kennard C, Landwehrmeyer B, Stout JC, Borowsky B, 
Scahill Rl, Frost C, Langbehn DR: Potential endpoints for clinical trials in 
premanifest and early Huntington's disease in the TRACK-HD study: 
analysis of 24 month observational data. Lancet Neurol 2012, 1 1:42-53. 

32. Bachoud-Levi AC, Maison P, Bartolomeo P, Boisse MF, Dalla Barba G, Ergis 
AM, Baudic S, Degos JD, Cesaro P, Peschanski M: Retest effects and 
cognitive decline in longitudinal follow-up of patients with early HD. 
Neurology 2001, 56:1052-1058. 

33. Snowden J, Craufurd D, Griffiths H, Thompson J, Neary D: Longitudinal 
evaluation of cognitive disorder in Huntington's disease. J Int 
Neuropsychol Soc 2001, 7:33-44. 

34. Lawrence AD, Sahakian BJ, Hodges JR, Rosser AE, Lange KW, Robbins TW: 
Executive and mnemonic functions in early Huntington's disease. Brain 
1996, 119(Pt 5):1 633-1 645. 



Toh et al. Translational Neurodegeneration 2014, 3:15 
http://www.translationalneurodegeneration.eom/content/3/1/15 



Page 10 of 10 



35. Ho AK, Sahakian BJ, Brown RG, Barker RA, Hodges JR, Ane MN, Snowden J, 
Thompson J, Esmonde T, Gentry R, Moore JW, Bodner T: Profile of 
cognitive progression in early Huntington's disease. Neurology 2003, 
61:1702-1706. 

36. Lemiere J, Decruyenaere M, Evers-Kiebooms G, Vandenbussche E, Dom R: 
Cognitive changes in patients with Huntington's disease (HD) and 
asymptomatic carriers of the HD mutation-a longitudinal follow-up 
study. J Neurol 2004, 251:935-942. 

37. McCaffrey RJ, Westervelt HJ: Issues associated with repeated 
neuropsychological assessments. Neuropsychol Rev 1995, 5:203-221. 

38. Salthouse TA, Tucker-Drob EM: Implications of short-term retest effects 
for the interpretation of longitudinal change. Neuropsychology 2008, 
22:800-811. 

39. Collie A, Ma ruff P, Darby DG, McStephen M: The effects of practice on the 
cognitive test performance of neurologically normal individuals assessed 
at brief test-retest intervals. J Int Neuropsychol Soc 2003, 9:419-428. 

40. Falleti MG, Maruff P, Collie A, Darby DG: Practice effects associated with 
the repeated assessment of cognitive function using the CogState 
battery at 10-minute, one week and one month test-retest intervals. 

J Clin Exp Neuropsychol 2006, 28:1 095-1 1 1 2. 

41. Bartels C, Wegrzyn M, Wiedl A, Ackermann V, Ehrenreich H: Practice effects 
in healthy adults: a longitudinal study on frequent repetitive cognitive 
testing. BMC Neurosci 201 0, 11:118. 

42. Roth J, Klempii J, Jech R, Zidovska J, Uhrova T, Doubek P, Ulmanova 0, 
Brozova H, Volfova M, Serranova T, Ruzicka E: Caudate nucleus atrophy in 
Huntington's disease and its relationship with clinical and genetic 
parameters. Funct Neurol 2005, 20:127-130. 

43. Bowie P, Branton T, Holmes J: Should the Mini Mental State Examination be 
used to monitor dementia treatments?. The Lancet 1999, 354:1527-1528. 

44. Clark CM, Sheppard L, Fillenbaum GG, Galasko D, Morris JC, Koss E, Mohs R, 
Heyman A: Variability in annual Mini-Mental State Examination score in 
patients with probable Alzheimer disease: a clinical perspective of data 
from the Consortium to Establish a Registry for Alzheimer's Disease. 
Arch Neurol 1999, 56:857-862. 

45. Lamer AJ, Julayanont P, Phillips N, Chertkow H, Nasreddine Z: Montreal 
Cognitive Assessment (MoCA): Concept and Clinical Review. In Cognitive 
Screening Instruments. London: Springer; 2013:1 11-151. 

46. Jauhar S, Ritchie S: Psychiatric and behavioural manifestations of 
Huntington's disease. Advances in Psychiatric Treatment 2010, 16:168-175. 

47. Phillips W, Shannon KM, Barker RA: The current clinical management of 
Huntington's disease. Mov Disord 2008, 23:1491-1504. 

48. Rao AK, Gordon AM, Marder KS: Coordination of fingertip forces during 
precision grip in premanifest Huntington's disease. Mov Disord 201 1, 
26:862-869. 



doi:1 0.1 186/2047-91 58-3-1 5 

Cite this article as: Toh et al:. Comparison of cognitive and UHDRS 
measures in monitoring disease progression in Huntington's disease: a 
12-month longitudinal study. Translational Neurodegeneration 201 4 3:15. 



Submit your next manuscript to BioMed Central 
and take full advantage of: 

• Convenient online submission 

• Thorough peer review 

• No space constraints or color figure charges 

• Immediate publication on acceptance 

• Inclusion in PubMed, CAS, Scopus and Google Scholar 

• Research which is freely available for redistribution 



Submit your manuscript at (^\ RiftMM i rpntral 

www.biomedcentral.com/submit \^ ™omea centra I 



